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1 Introduction 



The general non-linear Backward Stochastic Differential Equations (BSDEs) were first intro- 
duced by Pardoux and Peng [16] in 1990. They have been studied since then by a lot of authors and 
have found various applications, namely in stochastic control, finance and the second order PDE 
theory. Fleming and Souganidis studied in a rigorous manner two-player zero-sum stochastic 
differential games and proved that the lower and the upper value functions of such games satisfy 
the dynamic programming principle, that they are the unique viscosity solutions of the associated 
Bellman-Isaacs equations and coincide under the Isaacs condition. So a lot of recent works are 
based on the ideas developed in [9]; see, for instance, Buckdahn, Cardaliaguet and Rainer [2], 
Buckdahn and Li [3], Hou and Tang [13]. The reader interested in this subject is also referred to 
the references given in [9]. BSDE methods, originally developed by Peng [17) . [18] for the stochastic 
control theory, have been introduced in the theory of stochastic differential games by Hamadene, 
Lepeltier [10] and Hamadene, Lepeltier and Peng pflj to study games with a dynamics whose dif- 
fusion coefficient is strictly elliptic and doesn't depend on the controls. In Buckdahn and Li [3j 
there isn't any such restriction on the diffusion coefficient and they used a completely new ap- 
proach to study the stochastic differential games. In their framework the admissible controls can 
depend on the whole past, including information occurring before the beginning of the game, and, 
with the help of a Girsanov transformation argument, the a priori random lower and upper value 
functions were shown to be deterministic. This new approach in combination with BSDE methods 
(in particular the notion of stochastic backward semigroups, see Peng [T7]) allowed them to prove 
the dynamic programming principle (DPP) for the upper and lower value functions of the game as 
well as to study the associated Isaacs equations in a very straight-forward way (i.e., in particular 
without making use of so called r-strategies and vr-admissible strategies playing an essential role 

mm- 

El Karoui, Kapoudjian, Pardoux, Peng and Quenez [7] first studied RBSDEs with one barrier. 
The solution of a RBSDE is a triplet (Y, Z, K) where a "reflection" forces the solution Y to stay 
above a given continuous stochastic process which is called "obstacle" . This reflection is described 
by an increasing process K which pushes with minimal power the solution Y upwards the obstacle 
process S whenever it is touched by Y . The authors of [7] proved the existence and uniqueness of the 
solution by a fixed point argument as well as by approximation via penalization. They also studied 
the relation with the obstacle problem for nonlinear parabolic PDE's. In the Markov framework 
the solution Y of RBSDE provides a probabilistic formula for the unique viscosity solution of an 
obstacle problem for a parabolic partial differential equation. El Karoui, Pardoux and Quenez [8] 
found that the price process of an American option is the solution of an RBSDE. After that many 
authors have studied such equations and their applications. 

Wu and Yu [19j studied a kind of stochastic recursive optimal control problem with obstacle 
constraints where the cost function is described by the solution of RBSDE. They used Peng's BSDE 
method in the control theory (Peng [T7]) and require for this that all the coefficients are Lipschitz 
in their control variable. They show that the value function is the unique viscosity solution of an 
obstacle problem for the corresponding Hamilton-Jacobi-Bellman equations. 

In this paper we investigate two-player zero-sum stochastic differential games. But different 
from the setting chosen by the papers mentioned above, we consider a more general running cost 
functional, which implies that the cost functionals will be given by doubly controlled RBSDEs. 
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They are interpreted as a payoff for Player I and as a cost for Player II and should exceed a given 
obstacle constraint. As usual in the differential game theory, the players cannot restrict to play 
only control processes, one player has to fix a strategy while the other player chooses the best 
answer to this strategy in form of a control process. The objective of our paper is to investigate 
these lower and upper value functions W and U (see (3.9) and (3.10)). The main results of the 
paper state that W and U are deterministic (Proposition 3.1) continuous viscosity solutions of the 
Bellman-Isaacs equations with obstacles (Theorem 4.1). 

We emphasize that the fact that W and U, introduced as combination of essential infimum 
and essential supremum over a class of random variables, are deterministic is not trivial. For the 
proof of Proposition 3.1 we adapt the method from Buckdahn and Li [3]. This proposition then 
allows to prove the DPP (Theorem 3.1) in a straight forward way with the help of the method of 
stochastic backward semigroups introduced by Peng [17] and here extended to RBSDEs. However, 
we have to emphasize that the proof of the DPP for the stochastic differential games with reflection 
becomes more technical than that without reflection. One of the new elements of the proof of 
the DPP is an approved version of former estimates for RBSDE stated by El Karoui, Kapoudjian, 
Pardoux, Peng and Quenez [7] and by Wu and Yu |19j . In fact, we prove that, in the Markovian 
framework and under standard assumptions, the dependence of the solution on the random initial 
value of the driving SDE (on which also the obstacle process depends) is Lipschitz (Proposition 
6.1), and not only Holder with coefficient 1/2. This improvement of the estimate is not only crucial 
for the proof of the DPP but has also its own interest. 

We also underline that the proof that the lower and upper value functions W and U are deter- 
ministic (Proposition 3.1) continuous viscosity solutions of the associated Bellman-Isaacs equations 
with obstacles (Theorem 4.1) uses an argument which differs heavily from that used in [3] for the 
corresponding result without obstacle. In fact, we use the penalization method, and the proof that 
is a viscosity subsolution (Proposition 4.2) turns out to be particularly complicated: it is based 
on a non evident translation of Peng's BSDE method to stochastic differential games with obstacle 
(see, in particular, Lemma 4.5). As a byproduct of our results we obtain that the viscosity solution 
of the penalized equation (4.5) converges to the viscosity solution of the Hamilton-Jacobi-Bellman- 
Isaacs equation with obstacle (4.1) (Theorem 4.2). Finally, we prove the uniqueness (Theorem 5.1) 
of the viscosity solutions W and [/ in a class of continuous functions with a growth condition which 
was introduced by Barles, Buckdahn and Pardoux [1], that is weaker than the polynomial growth 
assumption. Their proof has to be adapted to our framework (Lemma 5.1) because we don't have 
the continuity of the viscosity sub- and supersolution a priorily but get it only by identifying both 
after the proof of the comparison principle (Theorem 5.1). In addition to the adaption of the proof 
to our framework we also simplify it considerably by reducing it to the comparison principle of 
Hamilton- Jacobi-Bellman equations. 

Finally, let us point out that a work on stochastic differential games with two reflecting 
obstacles (0]), which is based on the present paper, is available online. That work, separated from 
the present one in order to make the whole less heavy, has been used as a central key by Hamadene, 
Rotenstein and Zalinescu in their very recent paper |12j . 

Our paper is organized as follows. The Sections 2 and 6 recall some elements of the theory of 
BSDEs, RBSDEs and, in the Markovian framework, RBSDEs associated with forward SDEs, which 
will be needed in the sequel. Section 3 introduces the setting of stochastic differential games with 
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reflection and their lower and upper value functions W and U, and proves that these both functions 
are deterministic and satisfy the DPP. The DPP allows to prove that W and U are continuous. In 
Section 4 we prove that W and U are viscosity solutions of the associated Bellman-Isaacs equations 
with obstacles; the uniqueness is studied in Section 5. Finally, after having characterized W and U 
as the unique viscosity solutions of the associated Bellman-Isaacs equations with obstacles we show 
that W is less than or equal to U, and under the Isaacs condition, W and U coincide (one says 
that the game has a value). For the sake of readability of the paper the recall of basic properties 
of RBSDEs associated with forward SDEs, which are needed for our studies, is postponed to the 
appendix (Section 6). Some new results on RBSDEs are there given as well, namely Proposition 
6.1, already announced above. Moreover, in the second part of the appendix (Section 7) we give 
for the reader's convenience the proofs of Proposition 3.1 and Theorem 3.1. 



2 Preliminaries 

The purpose of this section is to introduce some basic notions and results concerning backward 
and reflected backward SDEs, which will be needed in the subsequent sections. In all that follows 
we will work on the classical Wiener space {Q,T,P): For an arbitrarily fixed time horizon T > 0, 
is the set of all continuous functions from [0, T] to W^, with initial value (O = Co([0, T]; M'^)) 
and J- is the Borel cj-algebra over Q, completed by the Wiener measure on P. On this probability 
space the coordinate process Bs{uj) = uJs, s G [0, T], u; € fi, is a d-dimensional Brownian motion. 
By F = {Ts, < s < T} we denote the natural filtration generated by the coordinate process B 
and augmented by all P-null sets, i.e., 

J=; = a{Br,r < s}y J\fp, se[0,T]. 

Here Afp is the set of all P-null sets. 

We introduce the following both spaces of processes which will be used frequently in the 
sequel: 

<S^(0,T;M) := {{ipt)o<t<T real-valued adapted cadlag process : 

E[ sup IV-tP] < +oo}; 

0<t<T 

7^^(0, r;M") := {{'ipt)o<t<T M"-valued progressively measurable process : 

(Recall that \z\ denotes the Euclidean norm of z G M"). Given a measurable function g : Q x 
[0,T] X M X M'^ ^ M with the property that (^(i, y, 2))^g[o,T] is F-progressively measurable for all 
(y, z) in M X M"^, we make the following standard assumptions on g throughout the paper: 

(Al) There is some real C > such that, P-a.s., for all t G [0, T], yi,y2 G M, zi,Z2 G M"^, 
\g{t,yi,zi) - g{t,y2,Z2)\ < C{\yi - y2\ + \zi - Z2\). 

(A2) 5(-,0,0) G 7^2(0, r;M). 

The following result on BSDEs is by now well known, for its proof the reader is referred to 
the pioneering paper by Pardoux and Peng [16| . 
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Lemma 2.1. Let the function g satisfy the assumptions (Al) and (A2). Then, for any random 
variable C L'^{0,Tt, P), the BSDE 



Yt = i+ f g{s,Ys,Zs)ds- [ ZsdBs, 0<t<T, (2.1) 
Jt Jt 

has a unique adapted solution 

{Yt,Zt)te[o,T]^S\0,T-R)xn\0,T;M.''). 

In the sequel, we always assume that the driving coefficient g a BSDE satisfies (Al) and (A2). 
Besides the existence and uniqueness result we shall also recall the comparison theorem for BSDEs 
(see Theorem 2.2 in El Karoui, Peng, Quenez [UJ or Proposition 2.4 in Peng 



Lemma 2.2. (Comparison Theorem) Given two coefficients gi and g2 satisfying (Al) and (A2) 
and two terminal values ^i, ^2 £ L'^{^,^t, P), we denote by {Y^,Z^) and (y^,Z^) the solution of 
the BSDE with the data {(,i,gi) and {^2^92), respectively. Then we have: 

(i) (Monotonicity) If > ^2 ^nd gi > g2, a.s., then Y^ > Y^ , for all t E [0,T], a.s. 

{ii) (Strict Monotonicity) If, in addition to (i), we also assume that P{S,i > £,2} > 0, then 
P{y/ > y/} > 0, for all 0<t<T, and in particular, Y^ > Y^. 

After this short and very basic recall on BSDEs let us consider now RBSDEs. An RBSDE 
is associated with a terminal condition ^ G L^(i7, JF^, P), a generator g and an "obstacle" process 
{St}o<t<T- We shall make the following assumption on the obstacle process: 

(A3) {St}o<t<T is a continuous process such that {St}o<t<T £ 5^(0, T;M). 

A solution of an RBSDE is a triplet {Y, Z, K) of F-progressively measurable processes, taking 
its values in M x x and satisfying the following properties 

(i) Y G 5^(0, r;R), Z G 7{^{Q,T-W^) and Kt G L^{n,TT,P); 

(ii) Yt = i + g{s, Ys, Z,)ds + KT-Kt- Z.dBs, t G [0, T]; (2.2) 

(iii) Yt > St, a.s., for any t G [0,T]; 

(iv) {Kt} is continuous and increasing, Kq = and / {Yt — St)dKt = 0. 

JO 

The following two lemmas are borrowed from Theorem 5.2 and Theorem 4.1, respectively, of 
the paper [7] by El Karoui, Kapoudjian, Pardoux, Peng and Quenez. 

Lemma 2.3. Assume that g satisfies (Al) and (A2), ^ belongs to L?'{Q.,!Ft,P), {St}o<t<T satisfies 
(A3), and St < (, a.s. Then RBSDE \2. 2\) has a unique solution {Y, Z,K). 

Remark 2.1. For shortness, a given triplet {C,g,S) is said to satisfy the Standard Assumptions if 
the generator g satisfies (Al) and (A2), the terminal value £ belongs to L'^{Q, Tt, P), the obstacle 
process S satisfies (A3) and St < a.s. 
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Lemma 2.4. (Comparison Theorem) We suppose that two triplets (^1,51, 5^) and (■^21 52) 5*^) sat- 
isfy the Standard Assumptions hut assume only for one of the both coefficients gi and g2 to be 
Lipschitz. Furthermore, we make the following assumptions: 

(i) 6 < 6, a.s.; 

(ii) giit,y,z) <g2{t,y,z), a.s., for {t,y,z) e [0,T] xR xR'^; 

(iii) Sl<Sl a.s., fortG[0,T]. 

Let {Y^,Z^,K^) and {Y^,Z^,K^) be adapted solutions of RBSDEs ^KM with data (^1,51,6'^) and 
{S,2, 92, S"^), respectively. Then, Y"/ < y/, a.s., fort € [0,T]. 

We will also need the following standard results on RBSDEs. 

Lemma 2.5. Let {Y,Z,K) be the solution of the above RBSDE \2. ^} with data {S^,g,S) satisfying 
the Standard Assumptions. Then, there exists a constant C such that 

£;[ sup / \Zs\^ds+\KT-Kt\^\Tt]<CE[e +{ f 5(s,0,0)ds^ + sup Sl\Tt]. 

t<s<T Jt \Jt J t<s<T 

The constant C depends only on the Lipschitz constant of g. 

Lemma 2.6. Let {(,,g,S) and {S^',g',S') be two triplets satisfying the above Standard Assumptions. 
We suppose that {Y,Z,K) and iY' , Z' ,K') are the solutions of RBSDE (2.2) with the data {S,,g,S) 
and [^',g',S'), respectively. Then there exists a constant C such that, with the notations, 

AC = ^-e, Ag = g-g', AS = S - S'; 

AY = Y -Y', AZ = Z -Z' AK = K - K' , 



it holds 



rp 

E[ sup \AYs\^ + / \AZs\^ds + \AKt - AKt\^\Tt] 

t<s<T Jt 

< CE[\ACf +( r \Ag{s, Ys, \Tt] + C { E[ sup \ASs?\:Ft^ 

\Jt / \ t<s<T 



1/2 



where 



|2 



^t,r = ^[|el'+ f / |5(s,0,0)|ds) + sup \Ss 

\Jt / t<s<T 

[ \g'{s,0,0)\ds] + sup \S'J^\Tt]- 

Jt / t<s<T 



+ irr + 

The constant C depends only on the Lipschitz constant of g' . 

The Lemmas 2.5 and 2.6 are based on the Propositions 3.5 and 3.6 in [7] and their general- 
izations by the Propositions 2.1 and 2.2 in [19], respectively. 

Remark 2.2. For the Markovian situation in which the obstacle process is a deterministic function, 
we can improve Lemma 2.6 considerably and show that Y is Lipschitz continuous with respect to 
the possibly random initial condition of the driving SDE (whose solution intervenes in the RBSDEs 
as well as in the obstacles), see Proposition 6.1 in the Section 6. 
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3 Stochastic Differential Games with Reflections and Associated Dynamic Pro- 
gramming Principles 



We now introduce the framework of our study of stochastic differential games with reflection 
for two players. We will denote the control state space of the first player by U, and that of the 
second one by V; the associated sets of admissible controls will be denoted by U and V, respectively. 
The set U is formed by all ?7-valucd F-progressively measurable processes and V is the set of all 
F-valued F-progressively measurable processes. The control state spaces U and V are supposed to 
be compact metric spaces. 

For given admissible controls u{-) G U and v{-) G V, the according orbit which regards t 
as the initial time and ( G L^(J7, .T^j, P; M") as the initial state is defined by the solution of the 
following SDE: 



J dxF'"'" = b{s, Xi'^'''^^ Us, vs)ds + a{s, Us, Vs)dBs, s € [t, T], 

where the mappings 



(3.1) 



6 : [0, T] X M" X [/ X F ^ and a : [0, T] x x ?7 x F ^ W""^ 
satisfy the following conditions: 

(i) For every fixed x G R", x, ., .) and a{., x, ., .) are continuous in (t, u, v); 

(ii) There exists a C > such that, for all t € [0, T], x, x' G R", u e U, ve V, (H3.1) 

\b{t, X, u, v) — b{t, x', u,v)\ + \a{t, x, u, v) — a{t, x' , u,v)\ < C\x — x'\. 

From (H3.1) we can get the global linear growth conditions of b and a, i.e., the existence of 
some C > such that, for all < i < T, u € U, v e V, x e R", 

\b{t,x,u,v)\ + \a{t,x,u,v)\ < C(l + \x\). (3.2) 

As recalled in Section 6, (6.2), it follows that, under the above assumptions, for any u{-) G U and 
v{-) G V, SDE (3.1) has a unique strong solution. Moreover, for any p>2, there exists Cp G R such 
that, for any t G [0,r], u{-) G U,v{-) G V and e i7(n, JF^, P; R"), we also have the following 
estimates, P-a.s.: 

^[ sup ixi'^'^'^-xF'^'l^'l^t] < Cpic-C'l^ 

E[ sup < Cp{i + ici^). ^ ■ ' 

sG[t,T] 

The constant Cp depends only on the Lipschitz and the linear growth constants of b and a with 
respect to x. 

Let now be given three functions 

$ : R" ^ R, /i : [0, T] x R" ^ R, / : [0, T] x R" x R x R'' x [/ x F ^ R 
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that satisfy the following conditions: 



(i) For every fixed {x, y, z) € M" x M x /(., x, y, z, ., .) is continuous in {t, u, v) and 
there exists a constant C > such that, for all t € [0, T], x, x' £ M", y, y' G M, z, z' 
eR'^, ueU and V e V, 

\f{t,x,y,z,u,v) - f{t,x',y',z',u,v)\ 

< C{\x - x'\ + \y - y'\ + \z - z'\); 

(ii) There is a constant C > such that, for all x, x' G M", 

|$(x) - «>(x')| <C|x-x'|; 

(iii) For every fixed x G M", x) is continuous in t and there is a constant C > 
such that, for all t G [0,r], x,x' G M", 

|/i(t,x) -/i(t,x')| < C|x-x'|. (H3.2) 

Moreover, 

h{T,x) < $(x), for all x G M". 

From (H3.2) we see that /, h and ^ also satisfy the global linear growth condition in x, i.e., there 
exists some C > such that, for ah < t < T, u eU, v eV, x G M", 

\f{t,x,0,0,u,v)\ + Mx)\ + \hit,x)\ <C(l + jx|). (3.4) 

Let t G [0,r]. For any u{-) G U, v{-) G V and C S L^{n, Tt, Pl^""), the mappings ^ := ^>(X^'^'"'''), 
Ss = h{s, Xt''''^'^) and g{s,y,z) := f{s,Xt''^'^'^,y,z,Us,Vs) satisfy the conditions of Lemma 2.3 on 
the interval [t,T]. Therefore, there exists a unique solution to the following RBSDE: 

(i) y*'^'«'^ G 52(t,r;M), Z*'^'"'^ G W2(t,r;R'^), and K^/'''''' e L'^{n, Tt, P); 

(ii) yi'^'"'" = $(X^^'"'") + /J /(r, y/''^•"'^ Z*'^'"'", Ur, Vr)dr + i^^^'"'" 

(iii) ys*'^'"''' > h{s, Xl''^'^'^), a.s., for any s G 

(iv) -ftr*''»'"''" is continuous and increasing, K^''^'^'^ = 0, 



(3.5) 



where X*'^'"''" is introduced by equation (3.1). 

Moreover, in analogy to Proposition 6.1, we can see that there exists some constant C > 
such that, for all < t < T, C,C e i^(f^, .Ff, P; M"), «(•) G U and v{-) G V, P-a.s., 



(ii) |y/'^^"'^|<c(i + |c|). 



Now, similar to Buckdahn and Li [3j, we introduce the following subspaces of admissible 
controls and the definitions of admissible strategies for the game: 

Definition 3.1. An admissible control process u = {ur,r G [t,s]} (resp., v = {vr,r G [t, for 
Player I (resp., II) on [t,s] {t < s < T) is an J- r -progressively measurable process taking values 
in U (resp., V). The set of all admissible controls for Player I (resp., II) on [t,s\ is denoted by 
Ut^s (resp., Vt^s). We identify two processes u and u in Ut^s and write u = u on [t,s], if P{u = 
u a.e. in [t,s]} = 1. Similarly, we interpret v = v on [t,s] for two elements v and v ofVt,s- 
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Definition 3.2. A nonanticipative strategy for Player I on [t,s]{t < s < T) is a mapping a : 
Vt^s — ^ i^t,s such that, for any Tr-stopping time S : Q ^ [t, s] and any vi,V2 € Vt,s with vi = 
V2 on l[t,S]J, it holds a{vi) = a{v2) on l[t,Sjj. Nonanticipative strategies for Player II on [t,s], 
P : Ut^s — ^ Vt^s, are defined similarly. The set of all nonanticipative strategies a : Vt^s — ^ l^t,s for 
Player I on [t,s] is denoted by At^s- The set of all nonanticipative strategies (5 : lAt^s — ^ '^t,s for 
Player II on [t, s] is denoted by Bt.s- (Recall that j[t,S]j = {(r, w) G [0, T] x fi, t < r < S{ijj)}.) 

Given the control processes w(-) £ Ut,T and v{-) ^ Vt,T we introduce the following associated 
cost functional 

J(t, X- u, v) := y/™, {t, x) G [0, T] x M'^, (3.7) 
where the process Y^'^''^''" is defined by RBSDE (3.5). 

Similarly to the proof of Proposition 6.2 we can get that, for any t £ [0,T], £ L'^{Q, J^t, P;W^), 

J{t, C; u, v) = y/'^'"''^, P-a.s. (3.8) 

We emphasize that J(t,(',u,v) = J{t,x;u,v)\x=( while y*'?'"'" is defined by (3.5). Being particu- 
larly interested in the case of a deterministic i-e., C = ^ ^ ^"'^ we define the lower value function 
of our stochastic differential game with refiection 

W{t,x) :=essmffj(zi3t .resssup^(,ij^ ^J{t,x;u,f3{u)) (3.9) 

and its upper value function 

U{t,x) := esssupQ,g_4^^essinf^eVt,T>^(*'^;«(^);^)- (3.10) 

The names "lower value function" and "upper value function" for W and U, respectively, are 
justified later by Remark 5.1. 

Remark 3.1. Obviously, under the assumptions (II3.1)-(II3.2), the lower value function W{t,x) 
as well as the upper value function U{t,x) are well-defined and a priori they both are bounded Tt- 
measurable random variables. But it turns out that W{t, x) and U{t, x) are even deterministic. For 
proving this we adapt the new approach by Buckdahn and Li J^. In the sequel we will concentrate 
on the study of the properties of W . The discussion of the properties of U which are comparable 
with those of W can be carried out in a similar manner. 

Proposition 3.1. For any {t,x) G [0, T] x M", we have W{t,x) = E[W{t,x)], P-a.s. Identifying 
W{t,x) with its deterministic version E[W{t,x)] we can consider W : [0,T] x M" — > M. as a 
deterministic function. 

The proof of Proposition 3.1 is similar to that of Proposition 3.3 in [3]. However, for the 
reader's convenience we give the proof in the Appendix II. 

The first property of the lower value function W{t, x) which we present below is an immediate 
consequence of (3.6) and (3.9). 

Lemma 3.1. There exists a constant C > such that, for all < t < T, x,x' G M", 

(i) \W{t,x)-W{t,x')\<C\x-x'\; 

(ii) \Wit,x)\ <C(l + lx|). ^ ■ ' 
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We now discuss (the generalized) DPP for our stochastic differential game with reflection 
(3.1), (3.5) and (3.9). For this end we have to define the family of (backward) semigroups associated 
with RBSDE (3.5). This notion of stochastic backward semigroups was first introduced by Peng [17] 
and applied to study the DPP for stochastic control problems. Our approach adapts Peng's ideas 
to the framework of stochastic differential games with reflection. 

Given the initial data {t,x), a positive number 6 < T — t, admissible control processes 
u(-) E l^t,t+s, G Vt.t+s and a real-valued random variable r] € L^(r2, P; M) such that 

t,x-,n 
t+5 



T] > h{t + 6, Xj'^^^''"), a.s., we put 



G*;jrW^=^i™' se[t,t + 6], (3.12) 

where the triplet (Yg'^'^'^ , Zg'^'^''" , -^s'^'"''')t<s<t+5 is the solution of the following RBSDE with time 
horizon t + 5: 

(i)y*™ € 52(t,t + 5;M),Z*™ G n'^{t,t + S;R'^), and i^*^^'^ g L'^{n,Tt+s,Py, 

_p.t,x;u,v _ jt+s zp^;n,v^^^^ se[t,t + 6]; (3.13) 
(iii)ys '^'"'^ > /i(s, Xs'^'"'^), a.s., for any s G [t,t + 6]; 
{w)K^' ' ' = 0, [Yr' -h{r,Xr' ))dKr' =0, 

where X*'^'"'"" is introduced by equation (3.1). 

Then, in particular, for the solution (y<,^;«>^', z*'^'"'^, K*-^'"'^) of RBSDE (3.5) we have 

^t,x;M,i) / x^t,x;M,ti\i ^t,x;u,Vfirt,x;u,v-i /oi^N 

Moreover, 

Jit,x;u,v) = Y^' ' ' =G^y [^{X^ )] =Gj;j;5' [Y^^^ ] 
t\tU [J{t + 6,X^'_^^ ■,u,v)]. 

Remark 3.2. For the better comprehension of the reader let us point out that if f is independent 
of {y, z) then 

G*;;;T[r?] = E[r^ + f^' f{r, n„ i;,)dr + K*;^''^ - se[t,t + 6]. 

J s 

Theorem 3.1. Under the assumptions (H3.1) and (H3.2), the lower value function W{t,x) obeys 
the following DPP : For any < t < t + 6 < T, x G M", 

W{t,x) = esstnf^^^^^^^^esssup^^u^^^^^Gl'^^^^^^^^ (3.15) 

The proof of Theorem 3.1 is very technique. But because we have got Proposition 6.1 the 
proof becomes possible with the help of the method of BSDE. On the other hand, we should 
pay attention to make sure the terminal condition is always above the obstacle. For the reader's 
convenience we give the proof in the Appendix II. 
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Remark 3.3. (i) From the proof of Theorem 3.1 (inequalities (7.2) and (7.7)) we see that, for all 

{t, x) G [0, T] X M", (5 > with < 6 < T - t and e > 0, it holds: 

a) For every (3 G St^t+S, there exists some u^{-) € Ut,t+6 such that 

W{t, x){= Wsit, x)) < G*J;"/''^^"'^ [W{t + S, + £, P-a.s. (3.16) 

b) There exists some (3^ G Bt^t+S such that, for all u G Ut,t+S, 

wit,x)i= Wsit,x)) > + p-a.s. (3.17) 

(ii) Recall that the lower value function W is deterministic. Thus, for S = T — t, by taking the 
expectation on both sides of (3.16) and (3.17) we can show that 

W(t,x) = infp^s^^^supy^^ii^^^E[J{t,x;u,P{u))]. 

For this we recall that 
In analogy we also have 

U{t,x) = sup^^j,^^^inf^^y^.^E[J{t,x;a{v),v)]. 

In Lemma 3.2 we have already seen that the lower value function W{t, x) is Lipschitz contin- 
uous in X, uniformly in t. With the help of Theorem 3.1 we can now also study the continuity of 
W{t,x) in t. 

Theorem 3.2. Let us suppose that the assumptions (H3.1) and (H3.2) hold. Then the lower value 
function W{t,x) is continuous in t. 

Proof. Let {t, x) G [0, T] x R" and 5 > be arbitrarily given such that Q < 5 < T -t. Our 
objective is to prove the following inequality by using (3.16) and (3.17): 

-C(l + \x\)5^ - C(l + |x|5)<53 - Csupj<g<j+5 \h{s,x) - h{t + d,x)\^ 

<W{t,x) - W{t + 6,x) (3.18) 

<C{l + \x\)S^ +C{l + \x\^)S'i +Csupt<5<t+5|/i(s,x) -h{t + S,x)\'2. 

Prom here we obtain immediately that W is continuous in t. We will only check the second 
inequality in (3.18), the first one can be shown in a similar way. To this end we note that due to 
(3.16), for an arbitrarily small £ > 0, 

W{t, x) - W{t + 5,x)< I] + Ij + £, (3.19) 

where 

Is ■■= Gif:;:;^^^'''\w{t+d,x)]-wit+d,x), 

for arbitrarily chosen /? G Bt^t+S and G Ut,t+S such that (3.16) holds. Prom Lemma 2.6 and the 
estimate (3.11) we obtain that, for some constant C independent of the controls and P{u^), 

< [CEi\Wit + 5,xl:^f^^^'''^)-Wit + 6,x)\'\J^t)]"^ 

< [Ci?(|x;;7^'^("^)-x|2|^,)]l, 
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and since _e;[|xJ:^>"''^("') _ x\^\rt] < C(l + \x\'^)5 we deduce that |7]| < C(l + \x\)5^. Note that 
W{t + 5,x)> h{t + 5,x). Then (F, Z, K) = {W{t + 5, x), 0, 0) is the solution of RBSDE (2.2) on the 
interval [t, t + (5] with the data C, = W{t + 5,x),g = 0,Ss = h{t + 5^x). On the other hand, from 
the definition of gJJ;"/ '^^"'^[-j (see (3.12)) and Lemma 2.6 we know that the second term /| can 
be estimated by 

< ^[(//+V(«,^^''^"''''^"'\w^(i + <5,^),0,n^,/3.(nn)d.)2|.F,] 

+C{E[snvt<s<t+6 |/i(s,xi'"^"^'^("^)) - h{t + 5,x)\^\J^t\)'^ 
—■ h,5 + h,5, 

where, by Schwartz inequality as well as the estimates (3.3) and (3.11), 

|/3,5|^ <5l^[//+'|/(s,X*'"'"''''("'\w^(t + 5,x),0,n^,/3,(<))l2d^ 
<5^S[//+'(|/(5,X*'"'"'''^("'\0,0,<,/3,(uf))l + C|^ 

< Cd'2E[Jl+\\l + \x'r'-''^(-n\ + \W{t + S,x)\fds\J^t]'^ 

< C{l + \x\)S 

and 

\h,5\' < C£;[sup,<,<,+5 |ft.(.s,xi'^'"'''^("')) - h{s,x) + h{s,x) ~ h{t + 5,x)\^\Ft] 

< Ci^[sup,<,<,+5 |/i(s,xi'"'"'''^("')) - h{s,x)\^\Ft] + C[snvt<s<t+S \K%x) - h{t + 5,x)|2] 

< C£;[sup,<,<,+, - + C[sup,<,<,+5 \h{s,x) - hit + 5,x)p] 

< C(l + |.T|2)5 + C[supi< s<j+5 |^('S, x) — h{t + (5, x)p]. 

Hence, from (3.19) and letting e J, we get the second inequality of (3.18). The proof is complete. 

□ 

4 Viscosity Solution of Isaacs Equation with Obstacle: Existence Theorem 

In this section we consider the following Isaacs equations with obstacles 

mm{W{t,x) - h{t,x),-§^W{t,x) - H~{t,x,W,DW,D'^W)} = 0, {t,x) G [0,r) x M", 
W{T,x) = ^{x), xGM", 

(4.1) 
and 

mm{U{t,x) - h{t,x),--§-^U{t,x) - H+{t,x,U,DU,D^U)} = 0, {t,x) G [0,T) x R", 
U{T,x) = ^{x), xGM", ^ ' ' 

associated with the Hamiltonians 

H~ (t, X, y, q, X) = sup„g[/inf^ey {^ir (c7(7^(t, x, u, v)X) + q.b{t, x, u, v) + f{t, x, y, q.a, u, v)} 

and 

H^{t, X, y, q, X) = inf^6vsup„g[/{^ir(a(T^(t, x, u, v)X) + q.b{t, x, u, v) + f{t, x, y, q.a, u, v)}, 
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respectively, where t € [0,T], x € M", y G M, g € and X G (recall that denotes the 

set of n X n symmetric matrices). Here the functions b,a,f and $ are supposed to satisfy (H3.1) 

and (H3.2), respectively. 

In this section we want to prove that the lower value function W{t,x) introduced by (3.9) is 
the viscosity solution of equation (4.1), while the upper value function U{t,x) defined by (3.10) is 
the viscosity solution of equation (4.2). The uniqueness of the viscosity solution will be shown in 
the next section for the class of continuous functions satisfying some growth assumption which is 
weaker than the polynomial growth condition. We first recall the definition of a viscosity solution 
of equation (4.1), that for equation (4.2) is similar. We borrow the definitions from Crandall, Ishii 
and Lions [5|. 

Definition 4.1. (i) A real-valued upper semicontinuous function W : [0,T] x M" — > M zs called a 
viscosity subsolution of equation (4-1) if W{T,x) < ^{x),for all x € M", and if for all functions 
if € Cff^{[0,T] X M") and {t,x) £ [0,T) x such that W — if attains its local maximum at {t,x), 
we have 



(ii) A real-valued lower semicontinuous function W : [0, T] x M" ^ M zs called a viscosity supersolu- 
tion of equation (4.I) ifW{T,x) > ^{x),for all x G M", and if for all functions ip G Cf^([0,r] xM") 
and {t,x) G [0,T) x M" such that W — attains its local minimum at {t,x), it holds 



(iii) A real-valued continuous function W G C([0, T] x M") is called a viscosity solution of equation 
(4-1) if it is both a viscosity sub- and a supersolution of equation (4-1)- 



differentiable up to the third order and whose derivatives of order from 1 to 3 are bounded. 

We now state the main result of this section. 

Theorem 4.1. Under the assumptions (H3.1) and (H3.2) the lower value function W defined by 
(3.9) is a viscosity solution of Isaacs equation (4-1), while U defined by (3.10) solves the Isaacs 
equation (4-2) in the viscosity solution sense. 

We will develop the proof of this theorem only for W, that of U is analogous. The proof is 
mainly based on an approximation of our RBSDE (3.5) by a sequence of penalized BSDEs. This 



generalization method for RBSDEs was first studied in [9], Section 6 (pp.719-pp.723). 

For each (t,x) G [0,r] x M", and m G N, let {(my^*.^;«.^^ m^t,^;",'^)^ ^ < s < T} denote the 
solution of the BSDE 






(4.1") 



Remark 4.1. Cf^{[0,T] x M") denotes the set of the real-valued functions that are continuously 




+ m 





We define 



Jm{t,x;u,v) ■.=^Yi 



-t,x;u,v 



u G Ut,T, V G Vt,T, 0<t<T, X G M' 



n 



(4.3) 
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and consider the lower value function 

Wmit,x) := essinff3(zBt j,esssu];)^f^K^,^Jm{t, x;u, (3{u)), <t<T, x € M". (4.4) 

It is known from Buckdahn and Li [3J that Wm(t, x) defined in (4.4) is in C([0, T] x R"), has linear 
growth in x, and is the unique continuous viscosity solution of the following Isaacs equations: 

-meruit, X) - SUp„g^inf^gi/{ltr(fT(T'^(t, X, u, v)D'^Wmit, x)) + DWmit, x).b{t, X, u, v) 

+fmit,x,Wm{t,x),DW.m{t,x).a{t,x,u,v),u,v)} =0, (t,x) G [0,r) xM", (4.5) 
W{T,x) = $(x), X e M", 

where 

fm{t,x,y,z,u,v) = f{t,x,y,z,u,v) + m{y - h{t,x))-, 

{t, x, y, z, n, t>) G [0, T] X R" X R X R'^ X [/ X V. 

We have the uniqueness of viscosity solution Wm in the space which is defined by 
G = {v3 € C([0, T] X R") : 3 I > such that 

lim|^,|^oo¥'(*;3;)exp{-^[log((|xp + l)^)]^} = 0, uniformly in t G [0,r]}. 

Lemma 4.1. For all {t,x) G [0,T] x R" and all m>l, 

Wi{t,x) < ■■■< W„r{t,x) < Wm+i{t,x) <■■■< W{t,x). 

Proof. Let m > 1. Since fm(t,x,y, z,u,v) < fm+iit, x,y, z,u,v), for all {t,x,y, z,u,v) we obtain 
from the comparison theorem for BSDEs (Lemma 2.2) that 

Jm{t,x,u,v) = "^Y^'^'^'^ < ™+iy^*'^''"''' = Jm+i{t, x,u,v), P-a.s., for any u G Ut^r and v G Vt^T- 

Consequently, Wm{t,x) < Wm+iit,x), for all (t,x) G [0,r] x R", m > 1. 

From the result of the Section 6 [pp.719-pp.723] in |7j, we can get that for each < t < T, 
X G R", u e Ut^T and v G Vt,T, 

Jm{t,x]u,v)<J{t,x]u,v), P-a.s. (4-6) 
It follows that Wm{t,x) < W{t,x), for all {t,x) G [0, T] x R", m > 1. □ 

Remark 4.2. The above lemma allows to introduce the lower semicontinuous function W as limit 
over the nan- decreasing sequence of continuous functions Wm, m > 1. From 

Wi{t,x) < W{t,x){= lim t Wm{t,x)) < W{t,x), {t,x) G [0,r] x R", 

and the linear growth of Wi and W we conclude that also W has at most linear growth. 

Our objective is to prove that W and W coincide and equation (4.1) holds in viscosity sense. 
For this end we first prove the following proposition: 

Proposition 4.1. Under the assumptions (H3.1) and (H3.2) the function W{t,x) is a viscosity 
supersolution of Isaacs equations (4-1) ■ 
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Proof. Let (t, x) G [0, T) x R" and let (p G Cfh{[0, T] x R") be such that W - (p > W{t, x) - (p{t, x) 
everywhere on ([0, T] x R"^) — {{t, x)}. Then, since W is lower semicontinous and Wm{t, x) | W{t, x), 
0<t<T,x&W^, there exists some sequence {tm,Xm), m > 1, such that, at least along a 
subsequence, 

'^){tm,Xm) it,x), as m ^ +oo; 

ii) Wm - <f> Wmitm,Xm) - ^{tm, Xm) in a neighborhood of {tm, Xm), for ah m > 1; 

iii) Wm{tm,Xm) ^ W{t,x), SS 171 ^ +00. 

Consequently, because Wm is a viscosity solution and hence a supersolution of equation (4.5), we 
have, for all m > 1, 

sup„e[/ ini^^v{-^tr{aa*{tm, Xm, u, v)D^ip{tm, Xm)) 

+b{tm, Xm, U, v)Dip{tm,Xm) + f{tm, Xm, Wm{tm, Xm),Dip{tm,Xm)(j{tm, Xm, U, v),U, v)} (-4 7) 
+m{Wm{tm,Xm) - h{'tm,Xm))~ 
< 0. 

Therefore, 

§i<p{tm, Xm) + SUp„g^ inf „6y { -tr(cT(T* {t 

m, Xm, 1^, ^ )D'^(f{tm,Xm)) 
m , Xm m, Xm, m, Xm 

), Dip{tm, Xm)cr{tm, Xm, U, v),U, v)} 

< 0. 

Prom {tm,Xm) it,x) and Wm{tm,Xm) W{t,x), as m — > +co, and the continuity of the func- 
tions b, a and / and, hence, their uniform continuity on compacts (recall that U, V are compacts) 
it follows that, for all m > 1, 
d 1 

-^(p{tm,Xm) + ^iTc{(^Cr*{tm,Xm,U,v)D^(p{tm,Xm)) 

+b{tm, Xm, U, v)D(p{tm, Xm) + f{tm, Xm, Wm{tm, Xm), Difiitm, Xm)cr{tm, Xm, U, v), U, v) 

converges uniformly in [u, v) towards 
d 1 

—(f{t,x) + -tT{au* {t,x,u,v)D'^ ip(t,x)) 

+b{t, X, u, v)Dif{t, x) + f(t, X, W{t, x),Dip{t, x)a{t, x, u, v),u, v). 
Therefore, 

§^(p{t, x) + sup„g,j inf„ey {-tr((7(T*(i, x, u, v)D^ip{t, x)) 

+b{t, X, u, v)Dip{t, x) + /(i, X, W{t, x), Dip(t, x)a(t, x, u, v),u, f )} i^-^) 
< 0. 

The above calculation shows that if W(t,x) > h{t,x) then we can conclude W is a viscosity 
supersolution of (4.1). For this we return to the above inequality (4.7), from where 

fTl{Wm{tm, Xm) ^(^mj^m)) 
> §t'f{tm, Xm) + SUp„g(7 inf ^ev' m, Xm, V )D'^ip{tm,Xm)) 

+b(tm,Xm,U,v)Dcp{t 

m , Xm m, Xm, m , Xm 

), Dip{tm, Xm)cr(tm, Xm,U, v), U,v)}. 

When m tends to +00 the limit of the right-hand side of the above inequality, given by the left 
hand side of (4.8), is a real number. Therefore, the left-hand side of the above inequality cannot 
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tend to — oo. But this is only possible if {Wm{tm,Xm) — h{tjn,Xm)) — > 0, i.e., if W{t,x) > h{t,x). 
The proof is complete. □ 

Proposition 4.2. Under the assumptions (H3.1) and (H3.2) the function W{t,x) is a viscosity 
subsolution of Isaacs equations (4-1) ■ 

Proof. We suppose that G C;^^([0,T] xR") and {t,x) G [0, T) x M" are such that W attains its 

maximum at {t, x). Moreover, we assume that x) = W{t, x) and W{t^ x) > h{t, x). If the latter 
condition didn't hold we would have W{t^x) = h{t,x) and thus also (4.1'). From the continuity 
of W and of h we conclude that there are some vq > 0, p > such that W{s,x') — h{s,x') > p 
for ah {s,x') € [0, T] x M" with \{s,x') - {t,x)\ < 2ro. On the other hand, by changing the test 
function (p outside the ro-neighborhood of {t,x) we can assume without loss of generality that 
W{s,x') - ip{s,x') < -p for all {s,x') e [0,T] x W with \{s,x') - {t,x)\ > 2ro. Consequently, 
taking into account that W > h, we have everywhere on [0,r] x the relation ip — h > p{> 0). 
For getting (4.1') we shall prove that 

Fo(t,x, 0,0) := sup„g[;inf^gyF(t,x,0, 0,^, -y) > 0, 

where 



(4.9) 



F{s, X, y, z, u, v) = -§^(p{s, x) + ^tr{aa'^ {s, x, u, v)D'^(p) + D(p.b{s, x, u, v) 
+/(s, x,y + ip{s, x),z + D(f{s, x).a{s, x, u, v), u, v). 

(s, X, y, z, u, v) G [0, T] x M" X M X R"' x [/ X V. 
Let us suppose that this is not true. Then there exists some ^ > such that 

Fo(i, X, 0, 0) = sup„g(7inf^gyF(t, x, 0, 0, u, v) < -9 < 0, (4.10) 

and we can find a measurable function if) -.U such that 

F(t, X, 0, 0, u, i){u)) < -9, for ah u e U. 

Moreover, since F{-, x, 0, 0, •, •) is uniformly continuous on [0,T] x U x V there exists some T — t > 
R > such that 

F{s,x,0,0,u,ip{u)) < ~9, for all G [/ and \s - t\ < R. (4.11) 



To continue the proof of Proposition 4.2 we need some auxiliary RBSDEs that are introduced 
and studied in the following: 

Lemma 4.2. For every u G Ut^t+8i v G Vt,t+5 o-'nd s G \t,t + 5\, we have the following relationship: 

Yi,u,v ^ G*; [^(t + S, Xl'^r)] - ^(^' ^'r^'^n, P-a.s., (4.12) 

where y}'^'^ is the first component of the solution of the following RBSDE defined on the interval 
[t,t + S\ {0<d<T-t): 

-dYs' =F[s,Xs' ,Ys' ,Zs' ,Us,Vs)ds + dKs' - dBg, 
i;ir = 0' > Ss := /i(s,xi'^'"''') - (^(.,xi'^^"'^), a.s., (4.13) 

i^i'"'" = 0, - Ss)dKl'''''' = 0, 

Recall the process X*'^'"'"" has been introduced by equation (3.1). 
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Remark 4.3. It's not hard to check that F{s, Xt'^'^'^ ,y, z,Us,Vs) satisfies (Al) and (A2). Thus, 
due to Lemma 2.3 equation (4-13) has a unique solution. 

Proof. We recall that + is defined with the help of the solution of the 

RBSDE 

' -dy,*'^'"'" = /(s, y^*™^ ^t,x;u,v^ ^^^^^ ^ dKi'^'"''' - Zt'^^'^^'^dBs, 

< = ^(t + S. y/'^'"'" > h{s, xi™), a.s., 

by the following formula: 

G'j^t+s" [^(t + ^I'+T)] = n*'"'"'"' se[t,t + 6] (4.14) 

(see (3.12)). Therefore, we only need to prove that f;*'^;"'" - ip(s, X*'^'"''') = y/'"'". This result can 
be obtained easily by applying Ito's formula to (p{s, Xl'^'^'^). Indeed, we get that the stochastic 
differentials of y*'-^'"^*' _ (^(^^ j^t,x,u,u-^ y^i,",t-' coincide, while at the terminal time t + S, y^j^^^'^ — 
^it + 6,xl'^-^'") = = y^^, and y*'"'"'" - (^(s, X^'"'"''') > /i(s, X*'"'"'") - (/.(s, X*™) = S^. Then 
from the uniqueness of the solution of the RBSDE the wished result follows. □ 

Let us now consider the following RBSDE defined on the interval [t, t + (5] {0 < S <T — t) : 

_^y^2,«,^ = F{s, Xi'^'"'", y/'"'", Us, Vs)ds + dK,''"''' - Zt^^'^^'dBs, 

y^''' = 0, y^'"''' > -p, a.s., (4.15) 

where u(-) G Ut,t+8, v{-) e Vt^t^s- 

Lemma 4.3. For every s&[t,t + 5], y}'""'" < Ys'""'" , a.s.. 

Proof. Notice that h{s, y) — (p{s, y) < —p, for all (s, y) G [t, T] x M". Therefore, the above assertion 
follows directly from Lemma 2.4 -the comparison theorem for RBSDEs. □ 

Finally we still study the following simpler RBSDE in which the driving process X*'^'"'" is 
replaced by its deterministic initial value x: 

' -dy/'"''' = F(s, X, y/'"'^ us,vs)ds + dKf - ■"'''ds,, 

< yir = 0' ^^''"''>-/^. a.s., (4.16) 
^3,«,« = 0, /^*+'^(y/'«'" + p)dKf = 0, 

where u(-) G Ut,t+5-, G Vt,t+5. The following lemma will allow us to neglect the difference 
^Y^,u,v _ y^3,«,^| jp^j, sufficiently small 5 > 0. 

Lemma 4.4. For every u G Ut,t+&, v G Vt,t+5, we have 
where C is independent of the control processes u and v. 
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Proof. Prom (3.3) we have for all p > 2 the existence of some Cp G M+ such that 

E[ sup IX*'"'"''^!^ I^i] < a,{l + P-a.s., uniformly in n G Ut,t+5,v e Vt,t+5- 

t<s<T 

This combined with the estimate 

E[ sup |X*'^'"'"-x|flJ-t] < 2P-^E[ sup I /;'6(r,X*'^'"'",u^,u^)(ir|P|Ji] 

t<s<t+i5 t<s<t+5 

+2P-^£;[ sup a{r,Xr''''''''',Ur,Vr)dBr\P\J^t] 
t<s<t+S 

yields 

E[ sup iX^'^'^'^-a^l^lJ^^t] <Cp5i, P-a.s., uniformly in n G Wt,t+5, e Vt,t+5. (4.18) 

t<s<t+5 

We now apply Lemma 2.6 combined with (4.18) to equations (4.15) and (4.16). For this we set in 
Lemma 2.6: 

6 = 6 = 0, gi{s,y,z) = F{s,Xl''''''''',y,z,Us,Vs), g2{s,y,z) = F{s,x,y, z,Us,Vs), 

S^ = S2 = -p, Ag{s,Y,^'-'\Z^'-'^)=g^{s,Y,^'-'\Z^'-'n-g2{s,Y,'^^^^ 

Obviously, the functions gi and 52 are Lipschitz with respect to (y, z), and \Ag{s, F^,^'"'^, Zs'^'^)\ < 
C(l + |x|2)(|xi™-x| + |X*'^'"'"-x|3), for s e [t,t + S],{t,x) e [0,r) xM-, ueUt,t+s,v e Vt,t+5- 
Thus, with the notation po{r) = (1 + |a;p)(r + r^), r > 0, we have 

< CE[{J^'^' |A3(.,y/'"'^Z,2'"•'^)|ds)2|^,] 

< C6E[J^'+^ \Ag{s, y.''"'^ Zs''"'")pds|J^t] 

< CSElJl^' plilxt^^^^''' - x\)ds\J^t] 

< CS^E[ sup p2(|^*,a:,«,._^|)|_^^^ 

t<s<t+S 

< C5\ 

Thus, the proof is complete. □ 
Lemma 4.5. There is some > such that, for all 5 G (0, 5q\ and for every u G Ut,t+8-i we have 



P-a.s. (4.19) 



C > is i/ie Lipschitz constant of F and thus in particular independent of the controls u and also 
of 5. Here, by putting ips{u){i~o) = ilj{us{io)), {s,lo) G [t,T] x Q,, we identify ip as an element of 

Proof. We observe that, ii 5 < R, for all (s, y, z, u) G [t, t + 5] x R x R'' x U, from (4.11) 

F{s,x,y,z,u,'4){u)) < C{\y\ + \z\) + F{s,x, 0,0, u,ij{u)) 
< C{\y\ + \z\)-'^e. 
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Consequently, from the comparison result for RBSDEs (Lemma 2.4) we have that Yg'^'^^^'' < 
F/, se[t,t + S], where is defined by the following RBSDE: 



-dy/ = {C(|y/| + \zf\) - ^d}ds + dKt - z^dB,, 

Kt = 0, !l^\Y^ + p)dKt = Q. 



Y,Xs = 0, > -P, a.s., (4.20) 



But, obviously, for S G (0, So] with 5o > small enough such that ^ (l — e '^^") < p, the unique 
solution of this RBSDE is given by 

= -^i'- ^''^'-^'^'^^) ' = 0, Kt = 0, . G [M + 5]. 
The assertion of the lemma follows now easily. □ 

The above auxiliary results now allow to complete the proof of Proposition 4.2. 
Proof of Proposition 4.2 (sequel). Due to the DPP (see Theorem 3.1), for every 5 G (0, (5o], 

>f{t,x) = W{t,x) = essinf^gei,,+iesssup„g;^^^^^^.G|;^';"/^"^[H^(i + 5, xj;^''^^"^)], 

and from W{s, y) < ip{s, y), for all (s, y) G [0, T] xM", and the monotonicity property of [.] 
(see Lemma 2.4) we obtain 

essinf^eB,,+,esssup„,j,^_^^,{G;j;"/(") [^{t + S, xj^^'^^"))] - ^{t, x)} > 0, P-a.s. 

Thus, from Lemma 4.2, 



and from Lemma 4.3, 



essinf/36B^_^_^^esssup„eW^_^_^^y/''''^^"^ > 0, P-a.s., 



essinf^gBt,t+5esssup„gi^^_^^^yt^'"''^^"^ > 0, P-a.s. 



Then, in particular, 

esssup„giY«,t+5^t > 0) P-a-s. 

Hence, given an arbitrary s: > we can choose G Ut^t+S such that, P-a.s., 



(The proof is similar to that of inequality (7.3) in the Appendix II.) Consequently, from Lemma 
4.4, 

YS,u^Mun > _csl - eS, P-a.s. (4.21) 
By combining this result with Lemma 4.5 we then obtain 



-CSl -eS< y/'«^^(«^) < (l - e-^^) , P-a.s. 

Therefore, 

-C(55 - £ < -- 



1 - e-^^ 



2C S 
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and by taking the limit as 5 J, 0, e J, we get < — | which contradicts our assumption that 9 > 0. 
Therefore, it must hold that 

Fo{t, X, 0, 0) = sup„g[/inf„gyF(t, x, 0, 0, u, v) > 0, 

and from the definition of F it follows that is a viscosity subsolution of equation (4.1). □ 

Proof of Theorem 4.1. From Theorem 5.1 which is proved in Section 5, Propositions 4.1 and 4.2 
we get W{t,x) < W{t,x). Furthermore, from Lemma 4.1 we obtain W{t,x) = W{t,x). The proof 
is complete. □ 

As a byproduct of the proof of Theorem 5.1 we have that the viscosity solution Wm of Isaacs 
equation (4.5) converges pointwise to the viscosity solution of Isaacs equation with obstacles (4.1): 

Theorem 4.2. Wmit,x) ] W{t,x), asm-* +oo, for any {t,x) G [0,r] x M". 

5 Viscosity Solution of Isaacs' Equation with obstacle: Uniqueness Theorem 

The objective of this section is to study the uniqueness of the viscosity solution of Isaacs' 
equation (4.1), 

f mm{W{t,x) - h{t,x),--§-^W{t,x) - H-{t,x,W,DW,D'^W)} = 0, {t,x) € [0,r) x M", 
I W{T,x) = <^{x), X € M", 

(5.1) 

associated with the Hamiltonians 

H'{t, X, y, q, X) = suj)^(,ijmfy(zv{^tr{aa'^ {t, x, u, v)X) + q.b{t, x, u, v) + f{t, x, y, q.a, u, v)}, 

t£[0,T], X G M", y G M, qeW, X & S". The functions b, a, f and $ are still supposed to satisfy 
(H3.1) and (H3.2), respectively. 

For the proof of the uniqueness of the viscosity solution we borrow the main idea from Barles, 
Buckdahn, Pardoux [l]. Similarly, we will prove the uniqueness for equation (5.1) in the space of 
functions 

e = {ip: [0, T] X ^ M|3 A > such that 

lim|^.|_,oo'^(t,a;)exp{-I[log((|x|2 + 1)5)]2} = 0, uniformly in t G [0,r]}. 

This growth condition was introduced in [1] to prove the uniqueness of the viscosity solution of 
an integro-partial differential equation associated with a decoupled FBSDE with jumps. It was 
shown in |1| that this kind of growth condition is optimal for the uniqueness and can, in general, 
not be weakened, even not for PDEs. We adapt the ideas developed in pj to Isaacs' equation (5.1) 
to prove the uniqueness of the viscosity solution in 0. Since the proof of the uniqueness in Q for 
equation (4.2) is the same we will restrict ourselves only on that of (5.1). Before stating the main 
result of this section, let us begin with two auxiliary lemmata. Denoting hy K a Lipschitz constant 
of f{t,x, ., .), that is uniformly in {t,x), we have the following 

Lemma 5.1. Let an upper semicontinuous function ui G © 6e a viscosity subsolution and a lower 
semicontinuous function U2 G 6e a viscosity supersolution of equation (5.1). Then, the upper 
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semicontinuous function uj := ui — U2 is a viscosity subsolution of the equation 

m.in{uj{t, x), —^uj{t, x) — sup^^u ^^Y{^tr{aa^ {t, x, u, v)D^uj) + Duj.b{t, x, u, v) + K\uj\ 

+ K\Duj.a{t,x,u,v)\)} = 0, (t, x) G [0, T) x M", (5.2) 

Lo{T,x) = 0, xGM". 

Proof. The proof is similar to that of Lemma 3.7 in [1], the main difference consists in the fact that 
here we have to deal with an obstacle problem and ui, U2 are not continuous. First we notice that 
uj{T,x) = ui{T,x)-U2iT,x) < = 0. For (tc^o) G (0,r) x R" let G Cl^{[0,T] x M") 

be such that {tQ,XQ) be a strict global maximum point of w — if. Separating the variables we 
introduce the function 

^'e,a(i, X, s, y) = ui{t, x) - n2(s, y) ^ ^ '^(*' 

where e, a are positive parameters which are devoted to tend to zero. 

Since {to,xo) is a strict global maximum point of w — if, there exists a sequence {t,x,s,y) 
such that 

(i) (t, X, s, y) is a global maximum point of ^e,a in [0, T\x x where B^ is a ball with a 
large radius r; 

(ii) {i,x), {s,y) {to,xo) as (e,a) ^0; 

(iii) , are bounded and tend to zero when (e, a) — > 0. 

Since U2 is lower semicontinuous we have lim (^^)_,n uy.js, y) > U2{to,XQ), and ui is upper semi- 
continuous we have lim^^ cf)^o ^i(^) ^) ^ ui{to,xo). On the other hand, from x, s, y) > 
^e,a(io,2;o,to,2;o) we get 

- — \x — (t — s)^ 

W2(s, y) < Ui{t, x) - Ui{to, Xo) + U2{to, Xo) + ip{to,Xo) - ip{t, x) 5 5 , 

and from where we have lim^^ q.-j^q '"2(^, y) < 'U2{tQ-,XQ). Therefore, we have 

(iv) lim(£ „)^o^^2(s,y) = U2{to,xo). 
Analogously, we also get 

(v) lim(j ,,)_oni(t,x) =ui(to,a;o)- 

Since (t, x, s, y) is a local maximum point of ^e,a, U2{s, y) + + achieves in (s, y) a local 

minimum and from the definition of a viscosity supersolution of equation (4.1) we have U2{s,y) > 
h{s,y). From (iv) we get U2{to,xo) > h{to,xo). Hence, if ui{to,XQ) < h{to,XQ) we have 

w{to,xo) = Ui{to,Xo) - U2ito,Xo) < 0, 

and the proof is complete. Therefore, in the sequel, we only need to consider the case that 
ui{to,xo) > h{tQ,xo)- Then, according to (v) and because h is continuous we can require 

(vi) ui(t,x) > h{t,x), for e > and a > sufficiently small. 

The properties (i) to (vi) and the fact that ui is a viscosity subsolution and U2 a viscosity 
supersolution of equation (5.1) allow to proceed in the rest of the proof of this lemma exactly as in 
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the proof of Lemma 3.7 in [T] (our situation here is even simpler because contrary to Lemma 3.7 
in [T], we don't have any integral part in equation (5.1)). So we get: 

--Q^{to,xo) -supu^u^^^v {h^r {{aa'^){to,xo,u,v)D^ip{to,xo)) + Dip{tQ,xo)b{to,xo,u,v) 

+K\uj{to,xo)\ + K\DLp{to,xo)a{to,xo,u,v)\} < 0. 

Therefore a; is a viscosity subsolution of the desired equation (5.2) and the proof is complete. □ 

Theorem 5.1. We assume that (H3.1) and (H3.2) hold. Let an upper semicontinuous function ui 
(resp., a lower semicontinuous function U2) £ Q be a viscosity subsolution (resp., supers olution) of 
equation (5.1). Then we have 

ui{t,x) < U2{t,x), for all {t,x) G [0, T] x M". (5.3) 

Proof. Let us put uj := ui — U2- Then we have, from Lemma 5.1 u; is a viscosity subsolution 
of equation (5.2). On the other hand, = is a viscosity solution of (5.2). Then, from the 
comparison principle for Hamilton-Jacobi-Bellman equations with standard assumptions on the 
coefficients (see, for instance, [19] ) it follows that uj < lo' = 0. Thus, the proof is complete. □ 

Remark 5.1. Obviously, since the lower value function W{t,x) andW{t, x) = limm^oo T Wm{t, x){< 
W{t,x)) (for the definition, see Lemma 4-1)! ^'^c ^ viscosity subsolution and a supersolution, re- 
spectively (see Proposition 4-1 o.'^^d 4-^)7 both are of linear growth and W < W, we have from 
Theorem 5.1 that W{t,x) = W{t,x), {t,x) £ [0,T] x M". Similarly we get that the upper value 
function U{t,x) is the unique viscosity solution in of equation (4-2). On the other hand, since 
< , any viscosity solution of equation (4-2) is a supersolution of equation (5.1). Then, 
again from Theorem 5.1, it follows that W <U . This justifies calling W lower value function and 
U upper value function. 

Remark 5.2. If the Isaacs' condition holds, that is, if for all (t,x,y,p,X) G [0, T] xM" xMxR" xS"-, 

H'{t,x,y,p,X) = H+{t,x,y,p,X), 

then the equations (5.1) and (4-2) coincide and from the uniqueness of the viscosity solution in it 
follows that the lower value function W{t,x) equals to the upper value function U{t,x), that means 
the associated stochastic differential game with reflections has a value. 

6 Appendix I: RBSDES Associated with Forward SDEs 

In this section we give an overview over basic results on RBSDEs associated with Forward 
SDEs (for short: FSDEs). This overview includes also new results (Proposition 6.1) playing a 
crucial role in the approach developed in this paper. 

We consider measurable functions b : [0,T] x n x W ^ M" and a : [0, T] x O x M" ^ M"^"' 
which are supposed to satisfy the following conditions: 

(i) b{-,0) and cr(-,0) are F-adapted processes, and there exists some 
constant C > such that 

\b{t,x)\ + \a{t,x)\ < C{1 + \x\),a.s., for all < t < T, x E M"; 

(ii) b and a are Lipschitz in x, i.e., there is some constant C > such that 

\b{t, x) — b{t, x')\ + \(j{t, x) — a{t, x')\ < C\x — x'\, a.s., 

for ah < t < T, x, x' G M". 
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We now consider the following SDE parameterized by the initial condition (t, C) ^ [0) ^] ^ 

j dX'/ = b{s,X'/)ds + a{s,X'/)dBs, se[t,T], ,^ ^, 

I = c. ^'-'^ 

Under the assumption (H6.1), SDE (6.1) has a unique strong solution and, for any p > 2, there 
exists Cp G M such that, for any t G [0, T] and C, C' e LP{n, Tt, P; M"), 

E[ sup \X'/ - X'/' \P\J^t] < CpjC-C'l^ a.s., 

t<s<T /g 2^ 

E[ sup \X'/\P\J^t] < Cp{l + \C\n, a.s. 

t<s<T 



These well-known standard estimates can be consulted, for instance, in Ikeda, Watanabe 
pp. 166-168 and also in Karatzas, Shreve [15], pp. 289-290. We emphasize that the constant Cp in 
(6.2) only depends on the Lipschitz and the growth constants of b and a. 

Let now be given three real valued functions f{t, x, y, z), $(x) and h{t, x) which shall satisfy 
the following conditions: 

(i) <I> : X ^ R is an J^t ® S(M")-measurable random variable and 

/ : [0, T] X X X M X M*^ ^ M, h : Q x [0,T] x W R 
are measurable processes such that, 

f{-,x,y,z), h{-,x) are J^j-adapted, for all {x,y,z) e M" x M x M*^; 

(ii) There exists a constant fi > such that, P-a.s., 

\f{t, X, y, z) - fit, x', y', z')\ < /i(|x - x'\ + \y - y'\ + \z - z'|); 
\<l>ix) - <^{x')\ <fi\y-y'\; 
\h{t,x) — h(t,x')\ < fi\x — x'\; 

for all < t < T, x, x' € M", y, y' G M and z, z' G W^; 

(iii) / and ^ satisfy a linear growth condition, i.e., there exists some C > 
such that, dt x dP-a.e., for ah x G M", 

|/(t,x,0,0)| + j<5(x)| <C(l + |x|) (H6.2) 
and, moreover, 

h{-,x) is continuous in t and h{T,x) < ^{x) a.s., for all x G M". 

With the help of the above assumptions we can verify that the coefficient f{s,x\'^,y,z) 
satisfies the hypotheses (Al), (A2), ^ = $(X^'^) G L'^{Q,Tt,P]R) and Ss = h{s,Xl'^) fulfills (A3). 
Therefore, the following RBSDE possesses a unique solution: 

(i) y*'f G 52(0,T;M), G 7i2(o,r;M'^) and K!f ^ L'^{^,Tt,P); 

(ii) y,*'^ = ^{X'^^) + /J f{r, X'/,Y}'^, Z'/)dr + K'^^ - K'/ - Z'/dB^, s G [t, T]; 

(iii) ys'^ > h{s,Xt''^), a.s., for any s G [t,T]; 

(iv) i^*'^ is continuous and increasing, K^''' = 0, {Yr'^ — h{r, Xr'''))dKr''' = 0. 



Proposition 6.1. We suppose that the hypotheses (H6.1) and (H6.2) hold. Then, for any < t <T 

and the associated initial conditions C,C' G L'^{^,^t, P]^"), we have the following estimates: 
{i)E[ sup \Ys''^\^ + ]j \Z'^^\^ds + \K'^^\^\Tt\ < C{1 + ICP), a.s.; 



t<s<T 
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(ii)^[ sup - yi'^'l Vt] < c|c - cf , 

t<s<T 

In particular, 

(iii) |y/'^|<C(l + |C|), a.s- 

(iv) |y/'^-F/'^'|<C|C-C'|, a... 

T/ie above constant C > depends only on the Lipschitz and the growth constants of b, a, f, $ 
and h. 

Proof. Prom Lemma 2.5 we get (i). So we need only to prove (ii). For an arbitrarily fixed e > 0, 
we define the function ■ip£{x) = {\x\^ + e)^ , x G M". Obviously, |x| < ■0£(x) < |a;| + £2, x E M". 
Furthermore, for all x G M", 

I / N 7-.2 I / N X 3^ 

Di>e{x) = r, D Mx) 



(|xP+£:)2 (|xp + £)2 (|a;p+£)2 

Then, we have 

\Dipe{x)\ < 1, \D^tj;eix)\\x\ < -\x\ <C, xe M", (6.5) 

(IxP +e)2 

where the constant C is independent of e. Let us denote by X*''' and X*'^' the unique solution 
of SDE (6.1) with the initial data (t, C) and {t,C'), respectively. Moreover, recall that jj, is the 
Lipschitz constant of h, and /. We consider the following two RBSDEs: 

(i)y G cS2(0,T;M), Z e n^{0,T;R'^) and Kt ^ L'^{^,J^T, P); 

{n)Ys = $(X^^) + fiMX'r^ - ^r'^') + I^ifir, X'/ , Yr, Zr) + ii\x'/ - x'/'\)dr 

+Kt -Ks- if ZrdBr , s€[t,T]; 
(iii)y, > h{s, X'/) + pLtl^e{Xl'^ - X'/), a.s., for any s G [t, T]; 
{iv)K is continuous and increasing, Kt = 0, 



(6.6) 



and 



J^{Yr - hir,X'/) - i^MX'/ - X'/'))dKr = 0. 



(i)F G 52(0,r;M), ZGW2(o,r;M^) and Kr e L^{n, J=-t, P); 
{u)Ys = $(X^«) - ti\X'/ - X'/\ + Jf (/(r, y,, Z,) - n\X'/ - X'r''^'\)dr 
+Kt -K,- JJ ZrdBr , s G [t , T] ; 

(iii) y, > h{s, Xl^^) - fi^X'/ - X'/'), a.s., for any s G [t, T]; 

(iv) if is continuous and increasing, Kt = 0, 

/f (y, - h{r,Xp^) + /xV'£(X*'^ - X'/'))dKr = 0. 



(6.7) 



Obviously, their coefficients satisfy the assumptions in (H6.2) and they admit unique solutions 
{Y, Z, K) and (F, Z, K), respectively. Moreover, from the comparison theorem for RBSDEs (Lemma 
2.4) 

ys<yl'^<Ys, Ys<Y^'^' <Ys, P-a.s., for all s G [i,T]. (6.8) 
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We shall introduce two other RBSDEs: 

(i) y' G 5^(0, T;R), Z' G rC-{Q,T;W^) and K'j, G L^{^,Tt,P)\ 

(ii) y; = ci>(x*;^)+ 

- + ^DVe(^r ^ - X*'^')(6(r,X*'^) - 6(r,X*'^')) 

- X,*'^')(c7(r,X*'^) - a(r,xK)),a(r,X*'«) - a(r,xK))]dr 
- i^^ - /J K^Br , s£[t,T]; 

(iii) !;' > h{s,Xt''^), a.s., for any s G [t,T]; 

(iv) K' is continuous and increasing, = 0, J^iYr ~ h{r,Xl'^))dK[. = 0, 

(6.9) 

and 

(i) F' G 52(0,T:M). Z' G ^^(0, T; M'') and Kl^ e L^{n,J^T,P); 

(ii) F; = - ^ix^*^ - x^^'i + ni>e{X*T - ^t''') + 

/f [/(r,^,*'^,^; - /iV^e(^r'^ - - fiDMX'r'^ - X*'«')(a(r,X«) - a(r,X«'))) 

-fx\Xl'^ - Xr'^'l - ^Dije{xi'^ - Xp^'){b{r,Xr'^) - b{r,Xr'^')) 

-i//(Z)V.(^r'^ - Xp'^'){a{r,X'/) - a{r,X'/')),a{r,X'/) - a(r,xK))]dr 
+K!r -K'^- /J , s G [t , T] ; 

(iii) y/ > /t(s,Xi''^), a.s., for any s G [t,T]; 

(iy)K' is continuous and increasing, K[ = 0, J^iYr ~ h{r,Xl'^))dK'^ = 0. 

(6.10) 

Obviously, also the RBSDEs (6.9) and (6.10) satisfy the assumption (H6.2) and, thus, admit 
unique solutions {Y', Z' , K') and (Y' , Z' , K'), respectively. On the other hand, from the uniqueness 
of the solution of RBSDE we know that 

= Ys- fiMXs'^ - X*'^'), for all s G [t,T], P-a.s., 
Z', = Zs - i^Dijeix'/ - x'/'){ais,x'/) - a{s,x'/')), dsdP-a.e. on [t,T] x O, (6.11) 
k', = Ks, for aU s G [t,T], P-a.s. 



y; = Z + f^MXl''^ - Xl'^'), for all s G [t,T], P-a.s., 

Z', = Zs + l^D^X'/ - X'/'){a{s, X'/) - a{s, X'/')), dsdP-a.e. on [t, T] x n, (6.12) 
K'^ = Ks, for ah s G [t,T], P-a.s. 

Then, for the notations introduced in Lemma 2.6 we have 

A<7(r, y;, Z;) = /(r, X'/, Y; + n^l^^iX'/ - X'/), Z; + fiD^X'/ - X'/'){cj{r, Xp^) air, X'/'))) 
-fir, X'/, Y; - liiJeiX'/ - X'/), Z[ - tiD^JeiX'/ - X'/')iair, X'/) - air, X'/'))) 
+2/x|X*'^ - Xp^'l + 2fiDil;eiXp'^ - X*'^')(6(r, X*'^) - 6(r,X*'^')) 

+fiiD^MX'/ - X'/)iair, X*'^) - a(r, X*'^')), a(r, X*'^) - a(r, X*'^')); 
Ae = At|X^^ - X^^'l - /x^e(^^^ - ^^^'); 
= 0. 

(6.13) 
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From (6.5) and the Lipschitz continuity of /, b and a we get 

\Ag{r,Y;,Z^)\ < C|X^'^ - + C7e^, P-a.s., 

|A^| < C\x!j^'^ - X^/\ + Cei, P-a.s., 

where the constant C is independent of e. Therefore, from Lemma 2.6 and (6.2) we get 

E[ sup |y; - Y^flJ't] < C\C - C? + Ce, P-a.s. 

t<s<T 

Furthermore, from (6.8), (6.11), (6.12) and (6.2) we have 

< 2i?[sup,<,<r |y; - Y^\^\Tt] + 16/i2(i?[sup,<,<^ \X'/ - X'/'\^\Tt] + e) 

< C\C-C'\^ + C£, p-a.s. 

Finally, we let e tend to to get (ii). The proof is complete. □ 

Let us now introduce the random field: 

u{t,x)=Y,''^l=t, {t,x) G [0,T] X M", (6.14) 

where F*-^ is the solution of RBSDE (6.3) with C G ^^(O, J-^, P; M") being replaced by x G R*". 
As a consequence of Proposition 6.1 we have that, for all t £ [0,T], P-a.s., 

(i) \u{t,x) -u{t,y)\ <C\x - y\, for all x,y eMJ"; , , 

(ii) |n(t,x)| < C(l + |x|), for all x G M". ^' ' 

The random field u and Y*''^, (t,C) G [0,r] x L'^{n,Tt,P;W), are related by the following 
theorem. 

Proposition 6.2. Under the assumptions (H6.1) and (H6.2), for any t G [0,r] and C, G L'^{Q,Tt, 
P;M"), we have 

u{t,C) = Yt'^, P-a.s. (6.16) 

The proof of Proposition 6.2 can be got by adapting the corresponding argument of Peng [IT] 
to RBSDEs, we give it for the reader's convenience. It makes use of the following definition. 

Definition 6.1. For any t G [0, T], a sequence {Ai}j^^ C J-t {with 1 < N < oo) is called a partition 
of (i7, Tt) if U^iAi = Q, and Ai n Aj = (j), whenever i ^ j. 

Proof (of Proposition 6.2): We first consider the case where ^ is a simple random variable of the 
form 

N 

C = J^xaA„ (6.17) 

■t=l 

where {Ai}fLi is a finite partition of (O, J-i) and Xj G W^, for 1 < i < N. 

For each i, we put {Xi,Y,\ Z^) = (X*'"^', y/'""', Z*'"^' ) . Then X'' is the solution of the SDE 

Xi = Xi + / h{r,Xi)dr+ / a{r,Xi)dBr, sG[t,r], 
Jt Jt 
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and (y*, Z'',K^) is the solution of the associated RBSDE 

Yi = + /J /(r, X;, Y;, ZDdr + K'^ - Kl - /J Z'^dB^, s G [t, T], 

Yi > h{s, Xi), J^{Y; - h{r, Xi))dKi = 0. 

The above two equations arc multipUcd by and summed up with respect to i. Thus, taking 
into account that ^<y9(xi)l^. = (^(^Xjlyi.), we get 

i i 

N N N N 

EU^Xl = ^XilA,+J^'bir,ZU,Xi.)dr + J^'a{r,ZU,Xi.)dBr 

1=1 i=l i=l 1=1 

and 

N N N N N 

JZUYi = ^^1a,X^t) + II fir,j:iA,Xl,j:iAY;,^U,Zl)dr 

i=l i=l i=l i=l i=l 

N N ^ N 

i=l 1=1 1=1 

N N N N N 

1=1 1=1 i=l 1=1 i=l 

Then the strong uniqueness property of the solution of the SDE and the associated RBSDE yields 

TV AT AT TV 

Xl^< = ^XllA^, iY,'''^,Zl''^,Kl'<) = {^1aX,T.^a.ZI,^1a^KI), s G [t,T]. 

i=l i=l i=l i=l 

Finally, from u{t, Xi) = Y^, 1 < i < N, we deduce that 

TV AT AT 

Yt'^'^ = Y,nu. = T.<t,x^)iA, = u{t,^x^iAj = u{t,o- 
1=1 1=1 1=1 

Therefore, for simple random variables, we have the desired result. 

Given a general C G L^{U,J^t,P',^"') we can choose a sequence of simple random variables 
{Ci} which converges to ( in L^(fi, P; R'*). Consequently, from the estimates (6.4), (6.15) and 
the first step of the proof, we have 

and y/'^* = u{t,Ci), i > 1- 

Then the proof is complete. □ 



7 Appendix II: Complement to Section 3 

We begin with the 

Proof of Proposition 3.1. We recall that Q = Co([0, T]; R'^) and denote by H the Cameron- 
Martin space of all absolutely continuous elements /i € whose derivative h belongs to L^([0, T], R^). 
For any h € H, we define the mapping r/ju; := uj + h, uj G ft. Obviously, r/i : O ^ O is a bijcction 
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and its law is given by P o [r^]-! = exp{J^ hsdB^ - i \hs\'^ds}P. Let (t,x) G [0,r] x be 
arbitrarily fixed and put Ht = {h E H\h{-) = h{- A t)}. We split now the proof in the following 

steps: 

1** step: For any u £ l^t,T, v G Vt^T-, h G Ht, J{t,x;u,v){Th) = J{t,x;u{Th),v{Th)), P-a.s. 

Indeed, for h £ Ht we apply the Girsanov transformation to SDE (3.1) (with = x). Notice 
that since h £ Ht, we have dBs{Th) = dBg, s G [t,T]. We compare the thus obtained equation 
with the SDE got from (3.1) by substituting the transformed control processes u{Th),v{Th) for u 
and V. Then, from the uniqueness of the solution of (3.1) we get Xi''''"'''(rfe) = x*'^'"^'^''^'''^^''^ 
for any s G \t,T], P-a.s. Furthermore, by a similar Girsanov transformation argument we get from 
the uniqueness of the solution of RBSDE (3.5), 

Yt,x;u,vi^^^-^ = y^*.^;«(^ft)."(^h), for any s G [t,T], P-a.s., 
^t^,x;u,v^^^^ = dsdP-a.e. on [t,T] x VL, 

Kl'^''''''{Th) = Kl'^-MrMrn) ^ for any s G [t,T], P-a.s. 
This implies, in particular, that 

J(t,x;u,v)(Th) = Jit,x;u(Th),v{Th)), P-a.s. 

2"<^ step: For /3 G Bt,T, h G Ht, let ^'^(u) := p{u{T-h)){Th), u G Ut,T. Then G Bt,T. 

Obviously, (3^ maps Ut,T into Vt,T- Moreover, this mapping is nonanticipating. Indeed, let 

S : \t,T] be an .7>-stopping time and ui,U2 G Ut^r with ui = U2 on [[t, S"]. Then, obviously, 

ui{T-h) = U2{T^h) on It, S{T-h)} (notice that S{T-h) is still a stopping time), and because (3 G ;Bt,T 
we have /3(tti(r_/i)) = j3{u2{T-h)) on S'(t_/i)|. Therefore, 

^'*(«i) = (3{u^{r^h)){rh) = f3iu2{T_h))irh) = P\u2) on lt,Sl 

3'"'^ step: For all h e Ht and /3 G Bt^T we have: 

{esssup„g2^^ ^J(t,x;u,/3(u))}(r^) = esssupy_^i^^^{J{t,x;u, p{u)){Th)}, P-a.s. 

Indeed, with the notation I{t, x, (3) := esssup^g^^ ^ J(t, x; u, P{u)), (3 G Bt^r-, we have /(t, x, (3) > 
J{t,x;u,(3{u)), and thus I{t,x, (3){Th) > J{t,x;u, (3{u)){Th), P-a.s., for all u G Ut,T- On the 
other hand, for any random variable ( satisfying ( > J{t,x;u, (3{u)){Th) and hence also C,{T-h) > 
J{t,x;u, I3{u)), P-a.s., for all G Wt,T, we have (^(r_^) > I{t,x, P), P-a.s.,i.e., C> I{t,x, P){Th), P-a.s. 
Consequently, 

I{t,x,(3){Th) =esssnpu^ii^^^{J{t,x;u,P{u)){Th)}, P-a.s. 

4*'* step: W{t,x) is invariant with respect to the Girsanov transformation Th, i.e., 

W{t,x){Th) = W{t,x), P-a.s., for any h^H. 

Let us first assume that h £ Ht. Then, similarly to the third step we can show that for all 
heHt, 

{essinf/3gH^ ^/(t,x;/3)}(r/i) = essm(p^Bt,T{Ht,x; /3){Th)}, P-a.s. 
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Then, using the results of the former three steps we have, for any h € Ht, 



W{t,x){Th) = essmf(3(zB,^esssup^(,u^^{J{t,x;u,/3{u)){Th)} 

= essinf^gB^ ^esssup^g^^^ J, J(t, x; u, (3^{u)) 
= essinf/3eBj_j,esssup„gi^^ J, J(t, x; u,P{u)) 
= W{t,x), P-a.s., 

where we have used the relations {u{Th)\u{-) G Ut^r} = ^t,T, £ ^t,T} = St^r in order to 

obtain the both latter equalities. Therefore, for any h € Ht, W{t,x) (r/j) = W{t,x), P-a.s., and 
since W{t, x) is jT-t-measurable, we have this relation even for all h H. Indeed, recall that our 
underlying fundamental space is $7 = Co([0, T]; M"^) and that, due to the definition of the filtration, 
the ^j-measurable random variable W{t, x){uj), w S fi, depends only on the restriction of lo to the 
time interval [0,t]. 

The result of the 4*^* step combined with the following auxiliary Lemma 7.1 completes our 
proof. □ 

Lemma 7.1. Let C, he a random variable defined over our classical Wiener space {0,,Tt,P), such 
that Ci^h) = C) P-a.s., for any h £ H. Then = E(, P-a.s. 

The proof of Lemma 7.1 can be found in Buckdahn and Li [3]. 



Let us come now to the 

Proof of Theorem 3.1. To simplify notations we put 

Wsit,x) = essmfp^s,,^^^esssup^^ij^^^^^Glf:^f^''\w{t + ,5, X*;"^]" '^^"))]. 

The proof that Ws{t,x) coincides with W{t,x) will be split into a sequel of lemmas which all 
suppose that (H3.1) and (H3.2) are satisfied. Let us fix € [0,r] x R". 

Lemma 7.2. Ws{t,x) is deterministic. 

The proof of this lemma uses the same ideas as that of Proposition 3.1 so that it can be 
omitted here. □ 

Lemma 7.3. Ws{t,x) < W{t,x). 

Proof. Let jS G Bt^T be arbitrarily fixed. Then, given a U2{-) € l{t+s,Ti we define as follows the 
restriction f3i of /3 to ■ 

Pi{ui) := P{ui eu2)\[t,t+S], ui{-) ^l^t,t+S, 

where ui © U2 ■= uil[i^i_^_s] + ^i2l(t+5,T] extends ui{-) to an element of Ut^r- It is easy to check that 
Pi G Moreover, from the nonanticipativity property of /? we deduce that /5i is independent 

of the special choice of U2{-) G Ut-^^s,T- Consequently, from the definition of Ws{t,x), 

Wsit,x) < esssup,,g^^,^^,G;;^4"/'^^("^)[W^(t + <^,X;;T-^^("^))], P-a.s. (7.1) 
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We use the notation Is(t, x, u, v) := Gl'^^g^[W{t+S, X^'^g^''")] and notice that there exists a sequence 
{uj, i > 1} C Ut^t+S such that 

Isit,x,Pi) := esssup„jg^^^^/5(i,x,ui,/3i(ui)) = supi>iIsit,x,u},Pi{u})), P-a.s. 

For any e > 0, we put Fj := {/^(t, x, (3i) < Is{t, x, uj, (3i{uj))+£} G J^t, i > 1- Then Fi := Fi, Fj := 
Fj\(UJ~|F;) G J^t, i > 2, form an (fi, jr()-partition, and nf := l^j>i Ir^^l belongs obviously to 
Ut^t+S- Moreover, from the nonanticipativity of Pi we have /?i(ttf) = X^j>i IriPiiuj), and from the 
uniqueness of the solution of SDE (3.1) and RBSDE (3.5), we deduce that /^(t, x, ttf , /9i(nf )) = 
12i>i^riIsit,x,u},Pi{u})), P-a.s. Hence, 

Ws{t,x)<Isit,x,Pi) < Z^>l'i-rJsit,x,uj,Pl{uj))+£ = Is{t,x,ul,Pi{ut))+s 

= G;;;;t''^^"^)[M/(t + (^,x;;7^'^^("^))]+£, p-a.s. ^ ' 

On the other hand, using the fact that := /?(• ©^2) G does not depend on U2{-) G Ut+S,T 

we can define f32{u2) := /3(uf © U2)\[t^s,T]^ for all U2{-) € IJt+s,T- The such defined (32 ■ Ut+5,T 
Vt+s,T belongs to Bt+s,T since /? G ^Sj^t- Therefore, from the definition of W{t + 6,y) we have, for 
any y G M", 

^^(^ + (5,?/) < esssup„2g;^^^^^J(t-F(5,y;'U2,/32(?X2)), P-a.s. 
Finally, because there exists a constant C G M such that 

(i) \W{t + 6,y) -W{t + 5,y')\ < C\y - y'l for any y, G M"; 

(ii) \J{t + 5,y,U2,f32iu2))-J{t + 6,y',U2,p2iu2))\<C\y-y'\, P-a.s., (7.3) 

for any U2 G Z^t+5,r, 

(see Lemma 3.2-(i) and (3.6)-(i)) we can show by approximating xf^g^'^'^^^^^^ that 

Wit + 5,xXf-^''^'''^^) < esssup„,,^,^^,_^J(i + 5,X;;7-'^^("^^);«2,/32(«2)), P-a.s. 

To estimate the right side of the latter inequality we note that there exists some sequence {uj, j > 
1} C Ut+s,T such that 

esssup„2eWt+5,T'^(* + '^'^t+5 ;^^2,/32(^i2)) = supj>iJ(t + ^ ^ ■,Uj,p2{uj)), P-a.s. 

Then, putting 

A, := {esssup„,,^^^^^^J(t + 5,X,*^f •''^("^^^2,/?2(^2)j < J{t + 5, xf^f-^'^'''^^ -y^, P2{u])) + e} G 
j > 1; we have with Ai := Ai, Aj := Aj\{uj~lAi) G j > 2, an (fi, ^t+5)-partition and 

:= Z]j>i lAjtfj G l^t+5,T- From the nonanticipativity of /?2 we have /32(tt2) = ^j>i ^^jl32{uj) 
and from the definition of /?2 we know that /3(wf ©«!) = Pii'^l) ©/?2(?i2)- Thus, again from the 
uniqueness of the solution of our FBSDE, we get 

Jit + sX':r'^''^''''^-,uhHu^)) = y;;/'^^^''^'"''--'^^^"^) (see (3.8)) 

= E,>ilA,J(i + 5,xJ;7-^^("?);u|,/32(n|)), P-a.s. 
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Consequently, 

W{t + S, x;;7-^^("^)) < esssup,,^^,^^,^ J(t + 5, xj^^-^^^"^); us, 02^) 

_ „t,a;;ufeu|,/3(«feu|) . ^ ' ' 

-i^t,x;u^ ,3(u^) , -r, 

= i^+i ^ +£, P-a.s., 

where := uf © G Ut,T- From (7.2), (7.4), Lemma 2.4 (comparison theorem for RBSDEs) and 
Lemma 2.6 we have 

Ws{t,x) < G;;3'^^("^)[y/|7^''^("^)+e]+e 

= G; Jit'^^"') + l)e (7.5) 

= + (C + 1)£ 

< esssup,ei,^^^y/'"'"'^(") + (C + l)e, P-a.s. 

Since /3 G Bt^r has been arbitrarily chosen we have (7.5) for all /? G 5t,T- Therefore, 

W5(t, x) < essinf;3gB,^esssup„ee^^^y/'^'""^^"^ + (C + l)e = W{t, x) + (C + l)e. (7.6) 
Finally, letting £ j 0, we get Ws{t,x) < W{t,x). □ 
Lemma 7.4. VF(t,x) < W5(t,x). 

Proof. We continue to use the notations introduced above. From the definition of Ws{t,x) we 
have 

Ws{t, X) = essinf^,,H,,,.esssup„,,^,^,^^,G;;7/'^^^"^) [Wit + <5, x;;T^./^^(-))] 
= essinf/3igB^^^^/5(t,x,/3i), 

and, for some sequence {/dj, i > 1} C 

Ws{t,x) = mfi>iIs{t,x,Pl), P-a.s. 

For any e > 0, we let Aj := {Is{t,x,/3l) - e < Ws{t,x)} E Tt, i > 1, Ai := Ai and Aj := 
AA(uj^|A;) e Tt, i> 2. Then {A„ i > 1} is an (SI, J^t)-partition, /3f := E»>i Ia./?/ belongs to 
Bt.t+5, and from the uniqueness of the solution of our FBSDE we conclude that Is{t, x, tii, /3f (tti)) = 
J2i>i'^AiIs{t,x,ui,Pl(ui)), P-a.s., for all ui{-) eUt,t+s- Hence, 

Wsit,x) > Ei>ilA,/5(t,x, /?!)-£ 

> T.i>i^A^Isit,x,ui,(3j{ui)) - e 

= Is{t,x,ui,(3f{ui)) -e 

= [Wit + 6, xj;7^'^i("^))] - e, P-a.s., for aU m G ^^,^+5. 

On the other hand, from the definition of Wit + 6, y), with the same technique as before, we deduce 
that, for any y G M**, there exists Py G Bt+s,T such that 

Wit + 6,y) > esssup^^^ii^^^^Jit + 6,y;u2,l3liu2))-e, P-a.s. (7.8) 
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Let {Oi}i>i C B{W) be a decomposition of such that Y^Oi = W and diam(Oi) <e, i>l. And 

i>i 

let yi be an arbitrarily fixed element of Oj, i > 1. Defining \^x^'^g^^'^''^^^^^] := J2 Vi^ t,a;;ui,/3f(ui) , 
we have 

_ j^M,ni,/3^(ni)j| ^ everywhere on J^, for all m G Ut^t+S- (7.9) 



Moreover, for each yi, there exists some j3y. G Bt+s,T such that (7.8) holds, and, clearly, /3f 

i>l i^t+s ^<^»x 

Now we can define the new strategy f3^{u) := /3f(ui) © /3^i(^2)5 u G Wt,T; where ui = 
it|[j^t_i_5] , U2 = (restriction of uto [t,t + 6]xQ, and (t + 5, T] x O, resp.). Obviously, maps 

Ut,T into Vt,T- Moreover, (3^ is nonanticipating: Indeed, let S : — > [t, T] be an J>-stopping time 
and u,u' G Ut^T be such that u = u' on Decomposing n, n' into ui,u'i G U2,U2 G 

Ut+s^T such that w = wi tt2 and u' = u'^^ © u'2 we have ui = u'^ on S* A (t + (5)J, from where 
we get /3f(ni) = /3i(?i'i) on A (t + 5)] (recall that /3f is nonanticipating). On the other hand, 
U2 ^ u'2 on lt + (5,5v(t + 5)|(c (t + 5,T] x {5 > t + (5}), and on {5 > t + we have xl'^'^'^^'^'''^ = 
^t,x,u^,p^{u^) ^ Consequently, from our definition, = (5^, on {S > t + 5} and /?u^(u2) = (^2) 
onlt + 5,5v(t + 5)l. This yields /?=(«)= /?f(^xi) © /?^^ (7x2) = /?f(txi) © /?^, (n^) = /3^(tx') on [t,^!, 
from where it follows that G Bt;r- 

Let now u G Ut.r be arbitrarily chosen and decomposed into ui = u\\^i^f_^g\^ G Ut,t+5 ^-nd 
= 'f^|(t+(5,T] S ^t+S,T- Then, from (7.7), (7.3)-(i), (7.9) and Lemma 2.6 we obtain, 

Ws{t,x) > '[Ty(t + 

> G;:^'^^(-)[iy(t + 5, [Xi;:;-'^^^-)]) + Ce] - Ce (7.10) 
= T^(t + 5,y,) + Ce]-C''£, P-a.s. 

Furthermore, from (7.8), (7.3)-(ii), (7.9), Lemmata 2.4 and 2.6, we have 

Ws{t,x) > G'*'^i"^i./3f("i)[^ 1 ,,*,.;.i./3f(.i)^^ J(t + 5,y,;iX2,/3^,(«2)) + - 
= g;'^^/'^^(-) [J(t + 5, [xl'X^''^^-^\u2, PIM^)) + Ce] - Ce 

- '^t,t+s i'^t+s J - 

= _ Ce, P-a.s., for any u G Wt,T. 

Here, the constants C and C vary from line to line. Consequently, 

Ws{t,x) > esssup^(,K^^^J{t,x;u,/3^{u)) - Ce 

> essinf^gB^_j,esssup„gj^^ J(t, x; u, f3{u)) - Ce (7.12) 
= W{t,x) - Ce, P-a.s. 

Finally, letting £ j we get Ws{t, x) > W{t, x). The proof is complete. □ 
Acknowledgment Juan Li thanks Shige Peng for helpful discussions. 
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